My code keeps having issuesFixWriting custom code is always going to be prone to issues. Use a framework like Scrapy for web crawling